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Abstract 

The  traditional  approach  to  measure  the  efficiency  of 
a  (static)  coverage  task  is  the  ratio  of  the  intersec¬ 
tion  of  the  areas  covered  by  sensors,  to  the  total  free 
space  in  the  environment.  Here  we  address  the  dy¬ 
namic  coverage  problem,  which  requires  all  areas  of 
free  space  in  the  environment  to  be  covered  by  sensors 
in  as  short,  a  time  as  possible.  We  introduce  a  fre¬ 
quency  coverage  metric  that  measures  the  frequency 
of  every-point.  coverage,  and  propose  a  decentralized 
algorithm  that  utilizes  locally  available  information 
about  the  environment  to  address  this  problem.  Our 
algorithm  produces  exploratory,  patrol-like  behavior. 
Robots  deploy  communication  beacons  into  the  en¬ 
vironment  to  mark  previously  visited  areas.  These 
nodes  act  as  local  signposts  for  robots  which  subse¬ 
quently  return  to  their  vicinity.  By  deploying  such 
(stationary)  nodes  into  the  environment  robots  can 
make  local  decisions  about  their  motion  strategy.  We 
analyze  the  proposed  algorithm  and  compare  it  with 
a  baseline  approach  -  a  modified  version  of  a  static 
coverage  algorithm  described  in  [1]. 

1  Introduction 

Coverage  [2]  is  the  problem  of  arranging  sensors  in 
the  environment,  usually  with  the  aim  of  detect¬ 
ing  targets.  The  target-detection  sensors  are  of¬ 
ten  mounted  on  mobile  robots,  thereby  reducing  the 
problem  to  one  of  robot  positioning.  Such  a  ca¬ 
pability  is  of  obvious  use  in  the  detection  of  un¬ 
friendly  targets  (e.g  military  operations),  monitoring 
(e.g.  security),  or  urban  search  and  rescue  (USAR) 
in  the  aftermath  of  a  natural  or  man-made  disaster 
(e.g.  building  rubble  due  to  an  earthquake  or  other 
causes). 

We  are  particularly  interested  in  the  regime  where 
the  number  of  robots  is  such  that  no  static  assign¬ 
ment  of  robots  to  vantage  points,  guarantees  full  cov¬ 
erage  of  the  environment.  This  will  often  be  the  case 
in  large  environments.  Further,  in  some  applications 


coverage  of  every  point  of  the  environment  at  every 
instant  may  not  be  required.  Thus  we  constrain  the 
problem  to  the  case  where  every  point  of  the  envi¬ 
ronment  should  be  covered  with  at  least  a  certain 
frequency.  While  we  assume  that  coverage  is  neces¬ 
sary  to  enable  capabilities  such  as  target  tracking, 
however  we  do  not  address  those  problems  here.  We 
focus  on  the  problem  of  positioning  multiple  robots 
in  a  planar  bounded  environment  to  maximize  their 
sensor  coverage  over  time. 

Our  solution  to  the  problem  relies  on  the  deploy¬ 
ment  of  beacons  into  the  environment  as  support  in¬ 
frastructure  which  the  robots  use  to  solve  the  cover¬ 
age  problem.  Robots  explore  the  environment,  and 
based  on  certain  local  criteria,  drop  a  beacon  into 
the  environment,  from  time  to  time.  Each  beacon  is 
equipped  with  a  small  processor,  a  radio  of  limited 
range,  and  a  compass.  We  describe  a  decentralized 
algorithm  that  performs  the  coverage  task  success¬ 
fully  using  only  local  sensing  and  local  interactions 
between  the  robots  and  beacons.  The  fundamental 
constraint  that  we  impose  on  the  solution  is  the  lack 
of  global  information  about  the  environment  (neither 
a  map  nor  an  access  to  global  positioning  informa¬ 
tion).  We  introduce  a  frequency  coverage  metric  that 
measures  frequency  of  every-point  coverage. 

We  compared  our  algorithm  to  a  (modified)  version 
of  a  prior  approach  in  which  robots  disperse  them¬ 
selves  in  the  environment  by  locally  repelling  interac¬ 
tion  in  order  to  ’fan  out’  to  expand  coverage  (we  call 
this  the  Molecular  approach  [1]).  Simulations  show 
that  our  algorithm  outperforms  the  molecular  algo¬ 
rithms.  In  addition,  the  present  algorithm  deploys  a 
static  network  of  nodes  into  the  environment  which 
has  applications  other  than  coverage. 

2  Related  Work 

The  coverage  paradigm  was  formulated  by  Gage  [2] 
and  divided  into  three  groups  of  useful  behaviors. 
Blanket  (or  Field)  coverage,  that  aims  to  achieve  a 
static  arrangement  of  agents  to  maximize  the  detec- 
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tion  rate  of  the  targets  in  the  sensor  shadows.  Barrier 
coverage,  whose  objective  is  to  achieve  a  static  ar¬ 
rangement  of  agents  with  the  task  of  minimizing  the 
probability  of  undetected  target  penetration  through 
the  barrier.  Sweep  coverage,  that  essentially  repre¬ 
sents  a  moving  barrier  coverage  or  can  be  achieved 
using  random  uncoordinated  motion  of  agents  (as 
shown  in  [2]).  The  problem  discussed  here  is  closely 
related  to  the  sweep  coverage  problem. 

The  problem  of  dynamic  coverage  is  also  related  to 
the  exploration  problem  in  an  unknown  environment 
which  has  been  studied  by  several  authors  [3,  4,  5]. 
The  frontier-based  approach,  described  in  detail 
in  [3,  4],  concerns  itself  with  incrementally  construct¬ 
ing  a  global  occupancy  map  of  the  environment.  The 
map  is  analyzed  to  locate  the  ‘frontiers’  between  the 
free  and  unknown  space.  Exploration  proceeds  in 
the  direction  of  the  closest  frontier.  The  multi-robot 
version  of  the  same  problem  was  addressed  in  [6].  [7] 
discusses  the  problem  of  deployment  of  distributed 
sensors  (robots)  in  the  wireless  adhoc  network  do¬ 
main.  In  their  setup,  the  communication  ranges  be¬ 
tween  the  robots  are  assumed  to  be  limited  and  the 
environment  is  assumed  to  be  big  enough  so  that 
the  network  connectivity  cannot  be  maintained.  A 
random-walk  algorithm  is  used  to  disperse  the  robot 
network  into  the  environment  to  support  communi¬ 
cation. 

The  approach  proposed  in  this  paper  differs  from  the 
above  mentioned  approaches  in  a  number  of  ways. 
We  use  neither  a  map,  nor  localization  in  a  shared 
frame  of  reference.  In  our  system  robots  deploy  a 
set  of  communication  beacons  into  the  environment 
in  order  to  coordinate  their  motions  to  improve  dy¬ 
namic  coverage.  The  basic  assumption  is  that  the 
beacon  nodes  that  the  robot  deploys  into  the  envi¬ 
ronment  are  small  and  have  a  compass. 

3  System  Architecture 

In  our  experiments  we  used  the  Player/Stage  [8,  9] 
simulation  engine  populated  with  simulated  Pioneer 
2DX  mobile  robots  equipped  with  two  180°  field-of- 
view  planar  laser  range  finders  positioned  back-to- 
back  (equivalent  to  a  2D  omnidirectional  laser  range 
finder),  color  camera,  vision  beacons  and  wireless 
communication . 

Our  algorithm  uses  two  entities:  the  communication 
beacons  and  the  mobile  robots.  The  task  of  each 
beacon  is  to  recommend  a  preferred  exploration  di¬ 
rection  for  robots  within  its  communication  range. 
Each  beacon  issues  only  a  recommendation,  robots 
combine  this  advice  with  local  sensing  to  make  a 
decision  about  which  direction  to  actually  pursue. 
Each  robot  is  equipped  with  a  2D  laser  range  finder 


Figure  1:  Beacon  Architecture 


with  which  it  performs  the  coverage  task.  Each  robot 
is  also  equipped  with  beacons  that  it  deploys  into  the 
environment  to  help  with  coverage. 

As  shown  in  Figure  1,  each  beacon  consists  of  a 
BroadcastDevice  in/outbox,  Controller,  States  block 
and  Advisor  block.  If  the  beacon  has  been  deployed, 
messages  are  directed  to  the  Controller  which  parses 
them  and  updates  the  States  block.  The  States  block 
consists  of  four  groups  of  states  corresponding  to  the 
four  directions  (South,  East,  North,  West).  Every 
group  has  three  states.  The  state  T  denotes  whether 
a  direction  is  OPEN  or  EXPLORED,  C  is  a  counter 
(if  T  is  EXPLORED,  then  C  counts  the  time  since 
last  update),  and  E  is  an  extra  field  for  network  in¬ 
formation  propagation  (direction  of  goal/home  state, 
etc.).  The  Advisor  block  computes  the  beacon’s  rec¬ 
ommendation  for  the  best  action  a  mobile  robot 
should  take  if  it  is  within  the  beacon’s  communi¬ 
cation  range.  The  computation  of  the  recommen¬ 
dation  is  simple.  All  OPEN  directions  are  recom¬ 
mended  first  (in  order  from  South  to  West),  followed 
by  the  EXPLORED  directions  with  largest  last  up¬ 
date  value  (largest  C  value).  The  beacon’s  recom¬ 
mendation,  generated  by  the  Advisor  block ,  is  sent  to 
the  BroadcastDevice  outbox  for  further  redirection  to 
nearby  robots. 

Each  mobile  robot  is  programmed  using  a  behavior- 
based  approach  [10].  Laser,  Vision  and  Position  are 
the  sensors  being  used.  Position  is  a  virtual  sen¬ 
sor  that  combines  odometry  and  compass.  Arbitra¬ 
tion  [11]  is  used  for  behavior  coordination.  Priorities 
are  assigned  to  every  behavior  a  priori.  As  shown 
in  Figure  2,  there  are  five  behaviors  in  the  system: 
ObstacleAvoidance,  Repel,  AtBeacon,  DeployBeacon 


Sensors 


Behaviors 


Outputs 


Figure  2:  System  Architecture  Figure  3:  Frequency  Coverage  of  point  P  at  time  T 


and  SearchBeacon.  In  addition  to  priority,  every  be¬ 
havior  has  an  activation  level,  which  decides,  given 
sensory  input,  whether  the  behavior  should  be  in  an 
active  or  passive  state  (1  or  0  respectively).  Each 
behavior  computes  the  product  of  its  activation  level 
and  corresponding  priority  and  sends  the  result  to 
the  Controller,  which  picks  the  maximum  value,  and 
assigns  the  corresponding  behavior  to  command  the 
Motor  Controller  for  the  next  cycle.  Obstacle  Avoid¬ 
ance  and  Repel  have  the  same  implementation  as 
described  in  [1],  One  of  the  state  variables  that  ev¬ 
ery  robot  keeps  track  of,  is  a  reference  to  the  last 
heard  beacon.  If  this  reference  switched  to  a  differ¬ 
ent  beacon  (i.e.  robot  moved  to  the  communication 
area  of  a  different  beacon),  AtBeacon  is  triggered. 
AtBeacon  analyzes  data  messages  received  from  the 
current  beacon  broadcasts.  If  the  direction  recom¬ 
mended  by  the  beacon  does  not  have  obstacles  (based 
on  an  analysis  of  the  laser  data),  the  robot  proceeds 
in  that  direction,  while  sending  an  update  beacon 
message  (this  message  updates  the  States  block  in 
Figure  1).  If,  however,  the  suggested  direction  is 
obstructed,  AtBeacon  sends  a  broadcast  message  up¬ 
dating  the  beacon  with  new  information  and  request¬ 
ing  a  new  suggestion.  SearchBeacon  is  triggered  after 
AtBeacon  chooses  and  positions  the  robot  in  a  cer¬ 
tain  direction.  The  task  of  SearchBeacon  is  to  travel 
a  predetermined  distance.  DeployBeacon  is  triggered 
if  the  robot  does  not  receive  a  ’’suggestion”  message 
(i.e.  a  recommended  direction  to  traverse)  from  any 
beacons.  In  this  case  the  robot  deploys  a  beacon  into 


the  environment. 

4  The  Frequency  Coverage  Metric 

The  idea  behind  the  proposed  metric  is  to  compute 
how  often  points  in  the  environment  are  visited  (i.e. 
are  covered  by  robot’s  sensors).  Consider  the  graph 
in  Figure  3.  For  a  particular  point  P,  which  is  not 
always  under  sensor  coverage  of  any  of  robots,  the 
graph  of  coverage  frequency  at  time  T  is  represented 
with  curve  OF.  The  ratio  of  area  under  OF  to  the 
theoretical  maximum  coverage  (area  under  OB)  rep¬ 
resents  the  frequency  coverage  metric  for  point  P  at 
time  T.  Therefore,  the  frequency  coverage  metric  g 
for  all  points  in  the  environment  is  given  by  : 

9= ihv  f  f  Wp^dxdy'  (1) 

W  =  max(wp), 

{tsicp  if  P  has  been  just  discovered, 

0  otherwise. 

where  A  is  the  area  of  the  environment,  T  is  the  cur¬ 
rent  time,  Ap  is  a  coverage  frequency  area  of  point  P, 
taicp  is  time  elapsed  since  last  coverage  of  P  and  wp 
is  the  weight  associated  with  point  P.  Note  that  in 
order  to  provide  a  fair  comparison  between  the  pre¬ 
viously  developed  static  algorithm  and  the  proposed 
exploratory  algorithm,  our  present  choice  of  wp  does 
not  “punish”  algorithms  for  not  covering  other  points 
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Figure  4-  Frequency  Metric  Estimation  tool 


of  the  environment.  The  frequency  coverage  metric 
over  the  time  of  execution  of  the  algorithm  can  be 
defined  with  equation  2: 

F  =  b  J0  9  dt  (2) 

A  software  application  has  been  created  which  keeps 
track  of  the  metric  F  and  allows  the  user  to  define 
the  granularity  of  computation,  regions  of  coverage 
interest,  and  shows  coverage  statistics  about  points 
in  the  environment.  A  screen  shot  of  the  application 
is  shown  in  Figure  4.  The  essential  principle  of  the 
tool  is  that  for  every  point  it  determines  whether  the 
point  is  in  sensor  shadow  of  any  of  the  robots  or  not 
and  update  the  statistics  appropriately.  Note  that  F 
is  a  cumulative  metric.  In  our  experiments  F  con¬ 
verged  to  a  steady  state.  Therefore,  a  single  experi¬ 
ment  that  results  in  that  state  is  considered  enough 
to  establish  the  value  of  F  for  a  given  configuration 
of  robots  in  a  team. 

5  Approach 

The  fundamental  idea  of  the  algorithm  is  simple.  A 
robot  explores  as  long  as  there  are  OPEN  regions  left. 


Figure  5:  The  simulation  environment 


If  all  regions  are  EXPLORED,  then  the  robot  picks 
the  direction  which  was  least  recently  explored.  As 
discussed  in  Section  3,  decisions  of  which  direction 
to  explore  next  are  made  by  beacons.  The  robots, 
however,  may  alter  those  decisions  if  real  world  ob¬ 
servations  (through  laser  data  analysis)  diverge  from 
the  beliefs  of  beacons.  In  addition,  the  Repel  behav¬ 
ior  ensures  that  the  robots  spread  out  in  the  environ¬ 
ment  as  far  as  possible  so  that  the  coverage  is  more 
effective.  Values  for  communication  radius  of  bea¬ 
cons  and  the  minimal  distance  between  the  beacons 
were  picked  empirically. 

6  Experiments  and  Results 

We  experimentally  tested  the  proposed  approach  and 
compared  its  performance  using  the  frequency  cov¬ 
erage  metric  with  the  Molecular  approach  described 
in  [1], 

Briefly  put,  the  Molecular  approach  causes  robots 
to  disperse  as  far  as  possible  into  the  environment. 
Every  robot  selects  a  ’repelled’  direction  of  motion, 
which  is  diametrically  opposite  to  the  average  angle 
subtended  by  all  its  neighbors  in  its  visual  field.  A 
set  of  local  algorithms  maximizing  sensor  coverage 
are  then  applied.  [1]  shows  that  Molecular  solves  a 
particular  coverage  problem  within  5-7%  of  the  man¬ 
ually  derived  optimal  case. 

Note  that  the  Molecular  approach  is  a  static  de¬ 
ployment  algorithm.  Therefore,  for  the  purpose  of 
reasonable  comparison,  the  conditions  of  task  termi¬ 
nation  of  Molecular  were  relaxed,  so  that  after  set- 


tling  down  into  the  equilibrium  state  the  motion  of 
robots  does  not  stop  and  its  frequency  coverage  met¬ 
ric  would  not  deteriorate.  The  general  setup  of  the 
experiments  for  both  approaches  consisted  of  teams 
of  size  1,  2,  3,  4  and  7  robots.  Figure  5  shows  the 
experimental  environment.  A  trial  terminates  when 
F  achieves  a  steady  state.  In  other  words,  if  there 
is  no  e  =  10-5  change  in  F  for  a  certain  amount  of 
time,  F  is  considered  to  have  reached  a  steady  state. 
As  shown  in  Figure  6,  the  proposed 


Figure  6:  Results  of  experimental  simulations  for 
groups  of  robots  for  the  Beacon-based  and  Molecular 
algorithms 

technique  outperforms  the  Molecular  approach.  In 
addition  to  a  better  dynamic  coverage  result,  the  pro¬ 
posed  algorithm  deploys  a  static  beacon  network  in 
each  of  the  test  cases,  that  can  be  used  for  a  number 
of  applications  later.  The  comparison  is  summarized 
in  Table  6. 


Table  1:  Experimental  Data 


Team  Size 

Molecular 

Beacon-based 

1 

0.1% 

0.17% 

2 

0.19% 

0.305% 

3 

0.32% 

0.45% 

4 

0.44% 

0.56% 

7 

0.8% 

0.81% 

7  Discussion 

As  seen  from  the  results  presented  in  Figure  6, 
the  difference  in  performance  between  the  two  ap¬ 
proaches  decreases  with  increase  in  the  number  of 
robots.  This  is  to  be  expected  however,  since  as  the 
environment  becomes  saturated  with  robots,  static 
algorithms  deploy  robots  such  that  they  cover  the 


whole  environment  without  significant  motion  at  all 
times.  Therefore,  the  cases  of  interest  here  are  those 
of  group  sizes  1,  2  and  3  robots.  Note  that  the  en¬ 
vironment  is  of  a  rather  small  size,  compared  to  the 
range  of  laser  sensors,  and  therefore,  the  environment 
becomes  saturated  even  with  4  robots.  As  shown  in 
Figure  7,  the  successfully  deployed  static  beacon  net¬ 
work  shows  that  the  proposed  algorithm  forces 
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Figure  7:  Final  state  of  the  deployed  static  sensor 
network  for  the  team  of  2  robots 

robots  to  explore  every  region  of  the  environ¬ 
ment.  Moreover,  a  patrolling  behavior  emerges 
where  robots  tend  to  revisit  points  over  time,  since 
they  are  not  allowed  to  settle.  Two  parameters  that 
were  picked  arbitrarily  for  the  proposed  algorithm 
are  the  beacon  communication  radius  Rb  and  dis¬ 
tance  that  the  robot  traverses  between  two  neigh¬ 
boring  beacons  Db  (this  is  not  required  to  be  precise 
and  our  simulations  trials  incorporate  some  odomet- 
ric  uncertainty  in  the  form  of  contaminant  noise) .  In 
our  present  implementation  Rb  =  3 m  <  Db  =  4.5m, 
where  Db  varies  due  to  noise.  Note  also  that  the  de¬ 
ployed  static  beacon  network  does  not  represent  an 
ideal  grid,  but  rather,  due  to  additive  noise  in  the 
simulation,  is  distorted.  However,  the  performance 
of  the  algorithm  does  not  deteriorate,  showing  ro¬ 
bustness  and  reliability  as  some  of  its  primary  qual¬ 
ities. 

8  Conclusion  and  Future  Work 

We  introduced  the  dynamic  coverage  task  and  pro¬ 
posed  a  decentralized  solution  to  it.  Our  solution  to 
the  problem  relies  on  the  deployment  of  beacons  into 


Figure  8:  Robotic  platform  for  exploration  ex¬ 
periments.  (left)  Pioneer  2DX  robot,  the  carrier. 
(right)  A  mote,  several  of  which  would  be  used  as 
beacons. 

the  environment  as  support  infrastructure  which  the 
robots  use  to  solve  the  coverage  problem.  Robots 
explore  the  environment,  and  based  on  certain  local 
criteria,  drop  a  beacon  into  the  environment,  from 
time  to  time.  We  compared  proposed  algorithm  to 
a  (modified)  version  of  a  prior  approach  in  which 
robots  disperse  themselves  in  the  environment  by  lo¬ 
cally  repelling  interaction  in  order  to  ’fan  out’  to  ex¬ 
pand  coverage.  Simulations  show  that  proposed  al¬ 
gorithm  outperforms  Molecular  algorithm.  In  addi¬ 
tion,  the  present  algorithm  deploys  a  static  network 
of  nodes  into  the  environment  which  has  applications 
other  than  coverage. 

In  our  future  work  we  plan  to  extend  the  weights  wp 
so  that  it  would  punish  the  coverage  algorithm  for 
not  visiting  areas  of  the  environment.  We  also  plan 
to  investigate  the  possibility  of  assigning  priority- 
areas  a  priori  for  frequent  coverage.  As  pointed  out 
in  section  5,  the  values  for  each  beacon’s  communica¬ 
tion  radius  and  the  inter-beacon  distance  were  picked 
in  an  adhoc  manner.  We  plan  to  investigate  the  opti¬ 
mal  dependencies  between  the  two  values,  their  effect 
on  the  coverage  frequency  metric  F  and  the  number 
of  beacons  required  for  a  given  environment.  The 
number  of  beacons  available  to  a  robot  is  assumed 
to  be  infinite  in  this  paper  (even  though  in  practice 
of  course  only  a  finite  number  are  needed/used).  We 
plan  to  extend  our  algorithm  with  switching  from 
exploration  mode  (search  for  OPEN  directions)  to 
patrolling  mode  (follow  the  EXPLORED  directions) 
in  case  the  robot  runs  out  of  beacons.  We  also  plan  to 
conduct  physical  robot  experiments  with  several  Pi¬ 
oneer  2DX  robots  carrying  communication  beacons 
(motes)  onboard  and  accomplishing  the  frequency 
coverage  task.  Figure  8  shows  the  physical  platform 
for  our  experiments. 

In  future  work  we  also  plan  to  exploit  the  deployed 
static  sensor  network  for  other  behaviors.  One  ex¬ 
ample  is  recovery,  when  after  being  deployed,  every 
robot  uses  the  network  to  return  to  ’’home  base”. 
The  propagation  of  information  through  the  network 


could  also  dramatically  increase  performance  of  the 
coverage  algorithm  itself  (e.g.  by  dynamically  ad¬ 
justing  the  beacon  drop-off  distance). 
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